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ABSTRACT 

A revised Spanish/English oral* proficiency test 
battery was adsinistered to 40 Spanish-surnaaed pupil» egually 
divided by sex at grade levels 1, 3, 5, and 7. The test battery 
included parallel Spanish and English versions of: (1) a 12<*itea 
vocabulary pretest, <2) a 32-iteB vocabulary-by-doaaln test 
consisting of fo*3r sections—hoae* neighborhood, church* and 
school — of eight iteas each, and (3) a 32-iteB graaaar production 
test requiring 10 different graaaatical operations. The pupils* 
perforaance was siallar (balanced) in both languages on the hoae and 
neighborhood doaains in all grades; Spanish was doalnant on the 
church doaain in grades 1 and 3, balance not being achieved un'cil 
grade 7. English was doalnant only on the school doaain In grade 5. 
Spanish was doalnant on the graaaar test through grade 5, with 
bilv;nce achieved In grade 7. The general tendency was for test scores 
to iaprove with grade level or years in school. The aaount of 
variance in the test scores that could be reliably attributed to 
language use (i.e., language spoken with father, aother, friends, 
etc.) or deaographic variables appeared saall. Inforaation about the 
reliability of test iteas and about correlations between the Spanish 
and English versions is given here, and the coaplete vocabUniary and 
graaaar tests are provided in appendixes. (Author/PHP) 
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Introductory Statement 



The Center's mission is to Improve teaching In American schools. 
Its work is carried out through five programs: 

Teaching Effectiveness 

* The Environment for Teaching 
Teaching Students from Low-Income Areas 

* Teaching and Linguistic Pluralism 

* Exploratory and Related Studies 

The study reported here furthers the work on language proficiency 
tests reported in R&D Memorandum No. 120 (Polltzer & McKay, A Pilot 
Study Concerning the Development of a Spanish/English Oral Proficiency 
Test . 1974) and R&D Memorandum No. 127 (Ramirez & Polltzer, A Revised 
Spanish/English Gramnar Test . 1974). 
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Abstract 



A revised Spanish/English oral-prof Iclency test battery was adminis- 
tered to 40 Spani8h«*sumamed pupils equally divided by sex at grade levels 
1* 3, 5, and 7. The test battery included narallel Spanish and English 
versions of (1) a 12-item Vocabulary Pretest, (2) a 32*item Vocabulary* 
by-Domain Test consisting of four sections»Homep Neighborhood, Church, 
and School — of eight items each, and (3) a 32-ltem Grammar Production 
Test requiring ten different grammatical operations. 

The reliability of the complete vocabulary test as memsured by the 
Cronbach a coefficient was *43 for the Spanish version and .77 for the 
English version. The relatively low Cronbach a for the Spanish version 
was largely the result of the low amount of variance in each of the four 
subtests (domains) which comprised the 32 items, and this was due to the 
homogeneity \of the sample in terms of its Spanish proficiency. Both 
versions of the grammar test measured with great reliability (Cronbach a 
of .87 for the Spanish and ,94 for the English). 

The English and Spanish versions of the complete vocabulary test, as 
well ah the four subtests, correlated highly with their respective ver- 
sions of the grammar test. The Spanish version of the vocabulary test 
(all domains) corrc^lated positively and significantly with the English 
version. These correlations were probably the consequence of the pupils* 
taking the entire test battery first in one language and then in the 
other* The two versions of the vocabulary test had identical multiple 
choice formats* 

The pupils* performance was similar (balanced) in both languages on 
the home and neiguuorhood domains in all grades; Spanish was dominant on 
the church domain in grades 1 and 3, balance not being achieved until 
grade 7; English was dominant only on the school domain in grade 5. 
Spanish was dominant on the grammar test through grade 5; balance was 
achieved In grade 7. The general tendency was for test scores to improve 
with grade level or years in school. 

The amount of variance in the test scores that could be reliably at-^ 
tributed to language use (i.e. language spoken with father, mother, 
friends, etc.) or demographic variables appeared small, probably because 
the pupils represented a relatively homogeneous group in which the use of 
Spanish was well established. 
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A REVISED SPANISH/ENGLISH ORAL PROFICIENCY 
TEST, 197A FIELD TEST RESULTS 



Arnulfo G. Ramfre* and Robert L. Polltzer 

The current Interest In measuring bilingual proficiency in Spanish 
and English has given rise to the development of various Spanish/English 
language tests (e.g. Burt, Dulay, & Hemfindez-ChSvez, 197A; Carrow, x973; 
and Cervenka, 1967) . The coauthors of this report have worked on the 
development of oral language production tests designed to give objectively 
laeasurable scores on parallel discrete items in Spanish and English 
(Polltzer & McKay, 1974; Ramirez & Polltzer, 1974). The purpose of this 
report Is to describe the experience gained with the latest version of 
the tests (both vocabulary and gramnar) and to report on findings concern- 
ing Spanish and English proficiency among students living in a predomi- 
nantly Spanish-speaking environment near the Mexican border and attending 
a school with a bilingual education program In the first and third grades. 

The Subjects 

Ten subjects (five boys and five girls) were randomly selected from 
the first, third, fifth, and seventh grades (total N-40) of the Crystal 
City Independent School District, Crystal City, Texas. Thirt/-8even of 
the subjects had been bom in the United States; three in Mexico. At the 
time the data were collected, the pupils tested in grades 1 and 3 were 
participating in a bilingual program In which the same amount of instruc- 
tional time was allotted to English and Spanish.^ The pupils in grades 5 
and 7 did not receive bilingual instruction but did come from the same 

^The Crystal City Bilingual Program has as its long-range objective 
"that the students leave the district as true bilingual citizens" 
(Application for a Bilingual Multicultural Education Program for 1974-75. 
p. 5). The bilingual instructional program has been extended to induce 
the fifth grade for the 1974-75 school year. 
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bi lingual sociocultural environment as the others* The summary of the 
Information given on a language use questionnaire administered at the 
beginning of the study (Table 1) makes It clear that by and large Spanish 
was the dominant language* Only for "language spoken with siblings** and 
**language preferred at school** did the Mned totals for use of English 
and English combined with Spanish add .o a figure larger than that 
for the use of Spanish* In the home environment » Spanish was clearly 
the dominant language; the exclusive use of English was reported by only 
two of the forty subjects of the study. 

TABLE 1 

Summary of Information on 
Language Use Questionnaire 
(N-40) 



Spanish English Both 



Language spoken at hone 


26 


2 


12 


Language spoken with mother 


28 


4 


8 


Language spoken with father 


32 


2 


6 


Language spoken with siblings 


17 


4 


X9 


Language npoken when entering school 


33 


5 


2 


Language spoken with friends 


22 


7 


11 


Language preferred at hone 


27 


11 


2 


Language preferred at school 


16 


15 


9 



There were three tests In each language. The pupils took all teats 
In one language on the first day and then took the entire battery In the 
other language on the second day. Since the pupils were selected randomly 
and the language of the test was assigned randomly (by flipping a coin), 
we hope to have reduced the effects of test language and the Interval 
between tests to as low a level as possible within the constraints of the 
school's schedule and pupil characteristics. 
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The Instrument a 

Vocabulary Pretest 

All pupils used as subjects in the study were given a simple vocab- 
ulary pretest in English and Spanish. The 12-1 tern multiple choice 
test called for matching one of three words or statements^ read by the test 
administrator » with a picture. All subjects used in the study had to 
score six or better before being given the main test. In fact, all sub-^ 
Jects did pass the pretests. 

Vocabulary-by-Domain Test 

There were 32 vocabulary test items, all of them used before with 
a different sample (Politzer & McKay, 197A) . On each* the subjects were 
to match one of three sentences, read by the test administrator, with a 
picture (see Appendix A) . In accordance with the sociolinguistlc concept 
of domain (see, for example, Fishman, 1972), the vocabulary test was 
divided Into four sections — home, neighborhood, church, and school — as 
in the prior test (Politzer & McKay, 1974). Each section was represented 
by eight test Items. 

Grammar Production Test 

A completely new 32'*ltem grammar test was devised » drawing on our 
earlier experience with a grammar production test (Ramirez «i Politzer, 
1974) . Subjects were cislced to perform linguistic operations on the model 
of illustrative samples given by the test administrator (see Appendix B) . 
There were ten different types of operations, requiring (1) change from 
singular to plural, (2) change from plural to singular, (3) change from 
present to pajt, (4) change from affirmative to negative, (5) Indication 
of location, (6) conversion of indirect to direct question, (7) conver- 
sion of indirect to direct command, (8) conversion of direct to indirect 
question, (9) conversion of direct to indirect command, and (10) change 
from positive to comparative in adjectives and adverbs. 

Tuo related pictures accompanied each item. Thrt test administrator 
read a sentence corresponding to one picture; the pupil responded by 
producing a statement corresponding to the other. 
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Scorlng 

Responses to each test Item were recorded by the test adndnlstrator^ 
Response categories were ^'expected** (1), **other acceptable reaponae'* 
(1) , "Incorrect" (0) and "no response" (0) • 



Analysis of the Tests 



Reliability of the Ite ms 

Table 2 shows the mean scores for all subjects » the standard devia- 
tions, and the reliability (Cronbach a coefficient) of each item. Not 



TABLE 2 



Mean, Standard Deviation » and Reliability of Test Used 

(N-40) 



Test Mean a.d* Cronbach a 



Vocabulary Pretest (Spanish) 


11.7 


0.56 


0.52 


Vocabulary Pretest (English) 


11.6 


0.67 


0.61 


Vocabulary-by-Domaln Test (Spanish) 








Dom-ln I (Home) 


7.7 


0.53 


-O.IA 


Domain II (Neighborhood) 


7.2 


0.83 


0.15 


Domain III (Church) 


6.5 


1.10 


0.12 


Domain IV (School) 


6.6 


0.96 


0.07 


Total Domains 


27.7 


2.17 


0.43 


Vocabulary-by-Domaln Test (English) 








Domain I (Home) 


7.6 


0.76 


0.47 


Domain XI (Neighborhood) 


7.1 


l.ll 


0.50 


Dooialn III (Church) 


5.3 


1.71 


0.59 


Domain IV (School) 


7.3 


0.82 


0.22 


Total Domains 


27.9 


3.30 


0.77 


GraiBBar Test (Spanish) 


26.6 


4.37 


0.87 


Gramar Test (English 


19.8 


8.59 


0.94 
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only the vocabulary pretest, but the entire vocabulary-by-domaln test was 
obviously easy for most of the subjects. For the vocabulary-by-domaln 
test the mean scores were 27.7 (Spanish) and 27.9 (English) out of a 
possible maximum score of 32. Several items were answered correctly by 
all subjects (see Appendix C) . The amount of variance measured by the 
tests was extremely low— a fact that Is in Itself largely responsible for 
the relatively low reliability of the subtests (domains). The Cronbach a 
coefficient for the combined domains (Spanish, .43; English, .77) Indicates 
at least respectable reliability for the vocabulary test as a whole. 

The grammar test, for which mean scores were 26.6 (Spanish) and 19.8 
(English) out of a possible 32, was more difficult than the vocabulary 
test . Both the Spanish and English versions of the grammar test measured 
with great reliability (Cronbach a of .87 for the Spanish version and .94 
for the English version) . Any reasonable and linguistically correct 
response wae accepted and scored as correct, even if it was not the one 
expected as a result of the model item. An analysis of the individual 
Items Indicated that in many cases the stimulus failed to elicit the 
expected grammatical construction, but resulted in an alternate acceptable 
answer (see Appendix D) . To what extent item difficulty reflects a prob- 
lem Inherent in perceiving the required task rather than the student's 
linguistic abilities is difficult to decide, but there is some Indication 
that the role played by the perceptlcn of the task is considerable. For 
Instance, Items 29, 30, and 32— all dealing with making comparisons-'were 
the most difficult in both the Spanish and English versions. It seems 
unlikely that such expressions as me lor , peor , mas , or better , worse , 
more would be part of the normal usage of only four or five of the forty 
subjects. The conclusion that the analogical task required by the test 
was difficult for the subjects appears more reasonable. 

Intercorrelatlons Among Tests 

The Intercorrelatlons among the tests and subtests are shown In Table 3. 
The most Interesting one Is the significant corr«*latlon of the Spanish 
vocabulary test (all domains) with the English vocabulary test ,46; 
p< .001). If proficiency ta one language were associated with lack of 
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proficiency In the other » the correlation would be negative. In fact» the 
reverfie la the caae. Stilly the poaltlve correlation does not seem to 
Justify the conclusion that proficiency In one language Is related to 
proficiency In the other, especially since the Spanish grammar test shows 
no strong relation to any of the English skills. What seems more plausi- 
ble is that the correlation of the Spanish and English vocabulary tests 
is produced by the test-taking ability (or transfer of learning) involved 
in both. One can only surmise that test-taking ability may also be respon- 
sible for the somewhat surprising relationship shown between the Spanish 
vocabulary test and the English grammar test (.42; p< .01). 

Analysis of Results 

Dominance Configuration 

Table U shows the mean scores achieved on all tests by grade and the 
significant differences between the Spanish and English scores. Table 5 
shows the dominance patterns. The subjects* performance was similar 
(balanced) In Spanish and English on Domain 1 (Home) and Domain II 
(Neighborhood) for all grades. Significant differences in favor of 
Spanish existed for Domain III (Church) in grades 1 and 3; balance was 
achieved by seventu grade. The only case of dominance in favor of English 
occurred In Domain IV (School) in the fifth grade. On the grammar test 
the pupils exhibited a dominance in Spanish In grades 1, 3> and 5; bal- 
ance was not achieved until the seventh grade* 
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TABLE 4 

Mean Scores, Standard Deviations, and Significant 
Differences of Means by Grade 



Spanish English Difference T-Value 
Grade Mean a.d. Mean s.d. of Means (2-Tail Prob ) 



Vocabulary Pretest 



1 


11.8 


0.40 


11.4 


0.84 


0.4 


1.50 


3 


11.5 


0.71 


11.6 


0.70 


-0.1 


-0.32 


5 


11.9 


0.32 


11.7 


0.48 


0.2 


1.50 


7 


11.6 


0.70 


11.5 


0.71 


0.1 


loOO 



Vocabulary"^)y*DoinalD Test 

Domain I (Home) 



1 


7.3 


0.68 


7.2 


0.92 


0.1 


0.29 




3 


7.7 


0.48 


7.3 


1.06 


0.4 


1.81 




5 


7.7 


0.4B 


8.0 


0.0 


-0.3 


-1.96 




7 


7.9 


0.32 


8.0 


0.0 


-0.1 


-1.00 


* 



Dcmalu II (Neighborhood) 



1 


6.6 


0.84 


6.3 


1.57 


0.3 


1.00 


3 


7.0 


0.94 


6.9 


0.99 


0.1 


0.25 


5 


7.5 


0,71 


7.7 


0.48 


-0.2 


-0.61 


7 


7.8 


0.42 


7.7 


0.48 


0.1 


0.43 



Domain III (Church) 



1 


6.5 


1.18 


4.0 


1.76 


2.5 


4.29** 


3 


5.7 


1.06 


4.2 


1.31 


1.5 


3.00* 


5 


6.8 


1.14 


6.5 


0.85 


0.3 


0.61 


7 


6.9 


0.74 


6.7 


0.66 


0.2 


0.48 


nnain 


IV (School) 












1 


6.6 


0.52 


6.8 


0./ 


-0.2 


-0.80 


3 


6.1 


1.20 


6.9 


0.88 


-0.8 


-1.81 


5 


6.6 


0,97 


7.9 


0.32 


-1.3 


-A. 35** 


7 


7.3 


0.82 


7.7 


0.68 


-0.4 


-1.50 



15 
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TABLE 4 (Cont'd.) 





Spanish 


English 


Difference 


T-Value 


Grade 


Mean 


a .d. 


Mean 


s.d. 


of Means 


(2-Tail Prob) 






Total Vocabulary Domain Test 




1 


27.0 


1.70 


24.0 


3.09 


2.7 


3.20* 


3 


26.5 


2.17 


25.3 


3.06 


1.2 


1.15' 


5 


28.6 


2.41 


30.1 


1.37 


-1.5 


-1.43 


7 


29.9 


1.66 


30.1 


1.37 


-0.2 


-0.28 






Gramniar 


Production 


Test 






1 


23.5 


6.19 


11.2 


7.74 


12.4 


3.02* 


3 


25.9 


4.23 


16.6 


6.45 


9.3 


4.15** 


5 


27.8 


2.25 


23.3 


2.63 


4.3 


4.82** 


7 


29.1 


1.52 


28.2 


5.05 


0.9 


0.55 


*p < 


.05 












**P < 


.01 


















TABLE 5 










Pupils' 


Language Dominance According to Grade 














Grade 






Test 




1 


3 


5 


7 


Domain I: Hoor 




B 


B 


B 


B 


Domain II: Neighborhood 


B 


B 


B 


B 


Domain III: Church 


S 


S 


S 


B 


Domain IV: School 


B 


B 


E 


B 




Total 




S 


B 


B 


B 


Granmar 




S 


S 


S 


B 



S'Spanlsh dominance 
E-Engllsh dominance 
B'Balstice 
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The teat results do not seem to reflect the language dominance con- 
figuration one would expect from a sample of Mexican-American pupils 
living In a predomlriantly Spanish-speaking environment near the Mexican 
border. Mexlcan-Aiuerlcan pupils account for 99 perccmt of the school 
population, and the city, which has a population of 10,000, appears to be 
a stable bilingual community In which Spanish Is used In the home and 
neighborhood, and English, until 1970, was the principal language of the 
school . 

The Spanish dominance reflected In Domain III (Church) and the gram- 
mar test In grades 1« 3, and 5 does seem to mirror the soclocultural 
reality. The balance shown In the domains of hoice and nelghhorhood, 
especially In the first two grades {1 and 3), may be only a mirage. An 
explanation of this "mirage'* might be found in the level of difficulty of 
the test or In the effort to make the domain tests parallel In the two 
languages. The parallelism may hcive eliminated the differences between 
some of the elements of Mexlcaii-ijnerlcan and Anglo*Amerlcan culture that 
probably can be reflectf'.d linguistically but cannot be measured with 
identical vocabulary items. 

Significant Source of Variance; Grade 

We expected to find that grade was a significant source of variance 
and that there was a general tendency for test scores to iiq)rove from the 
lower to the higher grades* In fact, the significant Improvement by grade 
is shown in two of the Spanish vocabulary subtests (Domain II: Neighbor- 
hood; Domain IV: School), the total Spanish vocabulary test, and the 
Spanish grammar test (see Table 6). In other words, among the Spanish 
tests only the pretest and the vocabulary subtests dealing with home and 
church did not vary significantly according to grade, evidently because 
even most of the first*-grade subjects seem to have been totally familiar 
with the vocabulary items included in those portions of the test. Among 
the English tests, on the other hand, all except the pretest show signif- 
icant variance and improvement associated with grade. 
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TABLE 6 

Summary of One-Way Analysis of Variance for 
Significant Variance Due to Grade 



Source 



Sum of Squares 



d.f. Mean Square 



Spanish Vocabulary Test 
Domain II (Neighborhood) 

Between Groups 
Within Groups 
Total 



8.48 
20.50 
28.98 



3 

36 
39 



2.83 
0.57 



4.96** 



Domain IV (School) 

Between Groups 
Within Groups 
Total 



7.30 
29.80 
37.10 



3 
36 
39 



2.43 
0.83 



2.94* 



Total Spanish Vocabulary 
Test 



Between Groups 
Within Groups 
Total 



72.20 
145.80 
218.00 



3 

36 
39 



24.07 
4.05 



5.94** 



Spanish Grammar Test 

Between Groups 
Within Groups 
Total 



171. 8C 
571.81 
743.61 



3 
36 
39 



57.27 
15.88 



3.61* 



English Vocabulary Test 
Domain I (Home) 

Between Groups 
Within Groups 
Total 



2.69 
15.21 
17.90 



2 

37 
39 



1.35 
0.41 



3.27* 



Domain II (Neighborhood) 

Between Groups 
Within Groups 
Total 



13.90 
35.20 
49.10 



3 

36 
39 



4.63 
0.98 



4.74** 
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TABLE 6 (Cont'd.) 



Source Sum of Squarcg d.f. Mean Square F 

Domain III (Church) 

Between Groups 62.90 3 20.97 13.93** 

Within Groups 54.20 36 1.51 

Total 117.10 39 

Domain IV (School) 

Between Groups 9.27 3 3.09 6.36** 

Within Groups 17.50 36 0.49 

Total 26.78 39 

Total English Vocabulary 
Test 

Between Groups 285.90 3 92.30 16.82** 

Within Groups 294.01 36 5.67 

Total 489.91 39 

English Crawar Test 

Between Groups 1670.08 3 556.69 16.62** 

Within Groups 1205.70 36 33.49 

Total 2875.78 39 



*p < .05 
**P < .01 



Effects of Demographic and Language 
Use Variables 

Of the variables gathered through the questionnaire on language use, 
rather few contributed to significant variation in the test scores 
(see Tablea 7 and 8) . Subjects who reported speaking Spanish with their 
mothers performed better on the neighborhood domain of the Spanish vocab- 
ulary test. Somewhat surprisingly, the three subjects who were bom in 
Mexico did significantly worse im the Spanish grammar test than the rest 
of the group. This fact could be interpreted only if case histories of 
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TABLE 7 

Means and Standard Deviations for Significant 
Variance due to Denograi>hlc and 
Language Use Variables 



N 



Mean 



s.d. 



Language Spoken with Mother 



Spanish Domain II (Neighborhood) 



Spanish 
English 
Both 



28 
4 
8 



7.4 

6.5 
6.9 



0.69 
0.50 
1.25 



Place of Birth 



Spanish Granuar Test 



USA 
Mexico 



37 
3 



27.1 
20.3 



2.y7 
12.22 



Language Spoken at Home 



English Vocabulary Pretest 



Spanish 
Eiikgllsh 
r.oth 



26 
2 
12 



11.5 
10.5 
11.8 



0.65 
0.71 
0.62 



Language Spoken with Friends 



English Domain II (Neighborhood) 



Spanish 
English 
Both 



22 
7 
11 



6.8 
7.7 
7.6 



1.34 
0.49 
0.52 



Language Spoken with Siblings 



English Domain IV (School) 



Spanish 
English 
Both 



17 
4 
19 



7 6 
7.8 
7.0 



0.80 
0.50 
0.82 
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TABLE 8 



Sumnary of One-Way Analysis of Variance for Significant Variance 
Due to Demographic and language Use Variables 



Source 



SS 



d.f. 



M.S. 



Language Spoken with Mother 



Spanish Domain II (Neighborhood) 



Between Groups 
Within Groups 
Total 



4.24 
24.73 
28.97 



2 
37 
39 



2.12 
0.67 



3.17* 



Place of Birth 



Between Grou^.? 
Within Group >i 
Total 



Spanish Granmar Test 



127.38 
616.24 
743.62 



1 
38 



127.33 
16.22 



7.86** 



Language Spoken at Home 

Between Groups 
Within Groups 
Total 



English Vocabulary Pretest 



2.69 
15.21 
17.90 



2 

37 



1.35 
0.41 



3.27* 



Language Spok'on with Friends 

Between Grcups 
Within Groups 
Total 



English Domain II (Neighborhood) 



7.08 
42.02 
49.10 



3 
37 
39 



3.54 
1.14 



3.12* 



Language Spoken with Siblings 

Between Groups 
Within Groups 
Total 



English Domain IV (School) 



3.91 
22.87 
26.78 



2 

37 
39 



1.95 
0.62 



3.16* 



*P < -01 
**p < ,05 
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the Individuals Involved were available. 

On the English side of the test battery, the vocabulary pretest ap- 
pears to have been influenced by language spoken at home. Those who spoke 
both languages did slightly better than those who spoke only Spanish; the 
two Individuals who spoke only English performed worse. On Domain II 
(Neighborhood) those who reported using English or both English and Spanish 
with their friends did slightly better than those who spoke only Spsnlsh. 
In Domain IV (School) those who reported using both languages with 
siblings had scores slightly below those using either Spanish or English. 

In general, the amount of variance in test scores that can be reliably 
attributed to language use or demogr^hlc variables appears small — prob- 
ably because the subjects represented a relatively homogeneous group in 
which the use of Spanish, at least within the home environment and with 
friends and siblings, seemed to be rather firmly established. 

Inpllcatlone 

The results of this study have three Implications. 

First, the performance of th(% subjects cn the English and Spanish 
tests, particularly the grammar te&rs, shows that "balance" is eventually 
reached, conflraAiJ^g previous findings. In a San Francisco study 
(Ramirez & Politzer, 197A), which also tested students in a bilingual 
education program, balance was reached in grade 3. The Crystal City 
pupils did not achieve balance until grade 7. The difference might be 
explained in terms of the different environment affecting the two groups 
(Crystal City, rural and near the border; San Francisco, urban and away 
from the border influence)., but since different versions of the grammar 
test were used« the findings are not entirely comparable. 

Second, at least for the Crystal City sample, Che home and neighbor- 
hood domains of the vocabulary test did not seem to represent language 
use accurately. In different situations (San Francisco vs. Crystal City) 
different levels of difficulty may be required to measure dominance or 
balance, because bala'ce and Imbalance can occur at different levels of 
performance (see Ramfrez & Politzer, 1974, p. 4). 
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Thlrd* the high correlation of the graanur test with the nultlple 
choice vocabulary teat (.81 In Engllah and .AO In Spanlah) may Justify a 
multiple choice format for the graanar test as an alternative to the 
production tea t» especially for use with larger aaaplea. 

Further testing Is being done using a multiple choice grsnnar test. 
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APPENDIX B 
Gramnar Production Test> English Version 
Category I^Slngular to Plural 

STIMULUS 



Sample: The pupil Is singing. 
Items ; 

1. This woman Is writing < 

2. This child Is eating. 

3. That goose Is fat. 



EXPECTED STUDENT RESPONSE 
The pupils are pinging. 

These women are writing. 
These children are eating < 
These geese are fat. 



Category II»Plural to Singular 

STIMULUS 



EXPECTED STUDENT RESPONSE 



Sample: The pupils are sitting at The pupil Is sitting at her desk, 
their desk. 



Items: 



4. The girls are studj^lng by The girl Is studying by herself, 
themselves. 



5. The boys are washing 
themselves « 

6. The girls are doing their 
homework. 

7. The girls are praying. 



The boy Is washing himself. 



The girl Is doing her homework. 



The girl Is praying. 



Category III «* Present to Past 

STIMULUS 

Saiq>le: Today the boy walks to 
school. 



Items : 

6. 



Today the mother gives 
the boy some candy. 



EXPECTED STUDENT RESPONSE 

Yesterday the boy walked to 
school. 



Yesterday the mother gave the 
boy some candy. 
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9. Today the girl eats 
an apple. 

10. Today the boy draws a 
picture . 



Yesterday the girl ate an apple. 



Yesterday the boy drew a 
picture* 



Category IV^Past Affirmative to Present Negative 



STIMOms 

Senile: Yesterday the girl was 
sick* 



EXPECTED STUDENT RESPONSE 



Today the girl lsn*t sick. 



Items: 



11* Yesterday the boys knew 
the answer. 

12. Yesterday the pupils did 
their homework. 

13. Yesterday the man had 
some money. 



Today the boys don*t know the 
answer* 

Today the pupils don*t do their 
homework. 

Today the man doesn^t have any 
money. 



Category V-Locatlon 

STIMULUS 

Fn^nple: Thl9 book Is next to 
thi(£ box. 

Items: 



EXPECTED STUDENT RESPONSE 

(Interviewer ! Where Is that 
book?) (Expected Student Response; 
That book l3 In the box*) 



14. 


This book Is 


In 


front 


I: 


Where Is that book? 




of the lan^. 






R: 


That book Is beside the lanq). 


15. 


This book is 


on 


the 


I: 


Where Is that book? 




desk. 






R: 


That book Is under the desk. 


16. 


This book Is 


on 


the 


I: 


Where Is that book? 




chair. 






R: 


That book Is on the table. 



3.^ 



CatcRory Vl'^eatlon (Indirect to Direct) 

STIMULUS 

Sample: The boy wants to know 
from hla mother where 
the book Is. 



EXPECTED STUDENT RESPONSE 

(Interviewer; He asks her: 
Where Is the book? What does 
the boy ask his mother?) 
(Expected Student iLesponee: 
Where la the book?) 



Items: 

17. The mother wants to know 
how the boy got so dirty. 

18. The mother wants to know 
If the ;;rlrl has washed 
the dlsbes. 

19. The mother wants to know 
If the girl can help her. 



I: What does the mother ask 

the boy ? 
R: How did you get so dirty? 

I: What does the mother ask the 
girl? 

R: Did you wash the dishes? 

I: What does the mother ask the 
girl? 

R: Can you help me? 



Category yil-^o— ends (Indirect to Direct) 

STIMULUS 

Sample: The teacher tells the 
pupil to give him the 
book. 



Items: 



20. The teacher tells the 
girl to hand her the 
notebook. 

21. The teacher tells the 
boy to take off his 
coat. 

22. The teacher tells the 
girl not to sit on her 
desk. 



EXPECTED STUDENT RESPONSE 

(Interviewer : He says: Give me 
the book! What does he say?) 
(Expected Student Response; Give 
me the book!) 



I; What does the teacher say to 

the girl? 
R: Give me your notebook. 

I; What does the teacher tell 

the boy? 
R: Take your coat off. 

I : What does the teacher > ay to 

the girl? 
R: Don't sit on my desk. 
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CatcRory VIII-Queatlong (Direct to Indirect) 



STIMULUS 



EICPECTED STUDENT RESPONSE 



Sample: The niother asks the 
girl: "Did you drop 
the pencil?" 



(Interviever : The mother vanta 
to icnov If the girl dropped the 
pencil. What does the mother 
want to know?) (Expected Student 
Response; She wants to know if 
the girl dropped the pencil.) 



Items; 
23. 



24. 



25. 



The mother aaks the girl: I: 

"Where did you put the 

bcx?" R: 



The mother asks the boy: I: 

"Did you brush your 

teeth?" R: 



The mother iska the girl: I: 
"Can you help me with the 
dishes?" R; 



What does the mother want to 
know? 

The mother wants to know where 
the girl put the box* 

What does the mother want to 
know? 

The mother wants to know if 
the boy brushed his teeth. 

What does the mother want to 
know? 

The mother wantfl to know if 
the girl can help her with 
the dishes. 



Category IX^Connands ^Direct to Indirect) 



STIMDLUS 

Senile : The teacher says to the 
pupil: "Give me the 
bookl" 



EXPECTED STUDENT RESPONSE 

(Interviewer* He wants the pupil 
to give him the book. What does 
he want of pupil?) 
(Expected S t udent Response ; He 
wants her to give him the book.) 



Items; 
26. 



27. 



The teacher says to the 
pupils: "Don't bother 
your neighbor!" 



The teacher says to the 
girls: "Read for me!" 



I: What does the teacher want 

of the pupils? 
R: The teacher wants them not 

to bother their neighbor. 

I: What does the teacher want 

of the girls? 
R: The teacher wants them to 

read for her. 
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STIMULUS 

28. Thm tsacher says to the 

boy: "Put on your coat!" 



EXPECTED STUDENT KESPOKSE 

I: What does the tet&cher want 

of the boy? 
R: The teacher wants hla to 

put on his coat. 



Category X-Comparlson 

STDflJmS 

Sanple: This girl Is tired. But 
Items: 



EXPECTED STUDENT RESPONSE 
This girl Is (even) more tired. 



29. These girls sing well. But This boy sings (even) better. 

30. This girl feels bad. But This girl feels (even) worse. 

31. This girl runs fast. But Thl4 girl runs (even) faster. 

32. This girl has lltte 

»on«y« But This boy has (even) less money. 



erJc 



36 



32 



Granmar Production Test. Spanish VTiion 
Categorta I-Del Singular al Plural 

EL ESTIMULO 



Ejemplo: Li ^luiKia estS 
can tan do. 

Las Oracionea: 



1. Esta mujer estf escribiendo 

2. Este nino estS comiando. 

3. Eate ganao estfi gordo« 



LA RESPUESTA ESPERA0A DEL ESTUDIANTE 



Loa alumoa eattn cantando 



Eataa oujerea eatin eacribiando< 
Eatoa ninoa eatSn comiendo* 
Eatoa ganaoa eatSn gordoa. 



Categoria I I-Del Plural al Singular 

EL ESTIMLTLO 

Ejemplo: Las alumias eatSn 

aentadaa en su nieaa. 

Laa Oracionea: 



4. Laa ninaa eatfin estudiando 
aolaa . 

5. Loa ninoa ae eatSn lavando. 

6. Laa ninaa eatSn haciendo au 
tarea^ 

7. Laa ninaa eatSn rezando. 



LA RESPUESTA ES?ERADA DEL ESTUDIANTE 

La alunna eat£ aentada en au 
meaa. 



La nine eatt estudiando sola* 

El nino ae eat£ lavando. 

La nine eatS haciendo au tarea< 

La nine eatfi resando. 



Catego^^a III*Del Tresente Indicativo al Pret^rito 

EL ESTIMULO LA RESPUESTA ESPERADA DEL ESTUDIANTE 

Ayer el nino camind a la escuela. 



Ejemplo: Hoy el nino camina a 
la eacuela. 

Las Oracionea: 



8. Hoy la madre le da dulce 
al nino. 

9. Hoy la nifia come una man- 
2ana. 



Ayer la madre le di6 dulce al 



nmo. 



Ayer la nine comi6 una manzana. 
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EL ESTIMULO 

10. Hoy el nlAo h«ct un 
dibuj o . 



LA RESPUESTA ESPERADA DEL ESTUDIANTE 
Ayer el nifio hizo un dibuj o. 



CateRorCe IV-Del Afiraetivo Peaedo al Negetivo Presence Indicarivo 

EL ESTIMULO LA RESPUESTA ESPERADA DEL ESTUDIANTE 



Ejemplo: La nine estaba 
enfema ayer. 

Laa Oracioneat 



11. Los nlnoa sablan la 
reapueata ayer. 

12. Las alumaa hicieron au 
tarea ayer. 



La nine no estf enferma hoy. 



Loa ninos no aaben la respueata 
hoy. 

Laa alumnaa no hacen su tarea 
hoy. 



13. El honibre tuvo dincro ayer. El honbre no tiene dinero hoy. 



Categoria V-Poaici6n y Lugar 

EL ESTIMULO 

Ejentplo: Este libro eatS 

al lado de la caja. 

Laa Oracionea: 



lA. Eate libro eatfi enf rente 
de la Ifai^ara. 



15. Eate libro eatfi sobre el 
eacritorio. 



16. Eate libro eatfi en la 
eilla. 



LA RESPUESTA ESPERADA DEL ESTUDIANTE 

(Examinador; ^DSnde eatfi ese 
libro?) 

(Reapueeta ea^erada del eatudiante ; 
Ese libro estfi en la caja.) 



E: £D6nde eatfi ese libro? 
R: Ese libro eatfi al lado de 
la Ifiopara. 

E: £D6nde eatfi ese libro? 
R: Ese libro estfi debajo del 
eecritorio. 

E: ^D6nde estfi ese libro? 
R: Ese libro estfi sobre la 
neaa. 
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CateRorfa VI-Frases de InterroRaciun (Del Indirecto al Directo) 



EL ESTIHQLO 

Ejemplo: El nino quiere 

aaber de su madre 
d5nde estS el libro. 



Las Oraciones: 



17, La madre quiere saber como 
se ensuciS tanto el nino. 



18. La madre quiere saber ai 
la nina lavS los places 



19. La madre quiere saber si 
la nina le puede ayudar. 



LA RESPUESTA ESPERADA DEL ESTUDIANTE 

(Examinador; El le pregunta: 
'7l>6nde escS el libro?" iQu€ 
le pregunta el nino a la loadre?) 
(Respuesta esperada del estudiante ; 
lD6nde estS el libro?) 



E: ^Qufi le pregunta la madre al 
nino ? 

R: ^C6iikO te ensuciaste tanto? 

E: £Qu£ le pregunta la madre a 

la nina? 
R: ^Lavaste los platos? 

E: iQu$ le pregunta la madre a 

la nina? 
R: ^Me puedes ayudar? 



Categorfa VII-Frases de Mandato (Del Indirecto al Directo) 



EL ESTIMULO 

Ejemplo: El maestro le dice a 
la alumna que le d£ 
el libro. 



Las Oraciones: 



LA RESPUESTA ESPERADA DEL ESTUDIANTE 

(Examinador; El dice: iDame el 
libro! iQu? le dice el maestro 
a la alumna?) 

(Respuesta esperada del estudiante: 
iDame el libro!) 



20. 



21, 



La maestrn dice a la 


E: 


iQu^ le dice la maestra a 


nina que le entregue el 




la nina? 


cuademo. 


R: 


IDame tu cuademo! 


El maestro le dice al nino 


E: 


iQui le dice el maestro al 


que se quite el saco. 




nino? 




R: 


iQuftate el saco! 


La maestra le dice a la 


E: 


iQui le dice la maestra a 


nina que no se siente en 




la nina? 


su escritorio. 


R: 


INo te sientes en mi 






escritorio! 
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Categorla VIII^Ttmm de Interrogac7.8n (Del Directo al Indirecto) 

EL ESTIMULO LA RESPUESTA ESPERADA DEL ESTUDIANTE 



Ejenplo: La madre le 

pragunta a la nina: 
**£Deja8te caer tu 
iCplz, 



Las Oracionea; 

23. La niadre le pregunta a 

la nina: "^DSnde pusiate 
la caja?** 

24* La iB^dre le pregunta al 
nino: '*£Te cepillaate 
loa dientea?** 

25 « La madre le pregunta a 
la nina: "^Me puedes 
ayudar a lavar loa 
platoa?*' 



(Examinador : La madre quiere 
saber si la nina dejS caer su 
Ifipiz, ^Qu^ quiere saber la 
madre?) 

(Respucsta esperada del estudiante: 
Ella quiere saber si la nina dej6 
caer su lSpiz«) 



E; lQ\xi quiere saber la madre? 
R: La madre quiere saber dSnde 
puso la nina la caja. 

E: iQni quiere saber la madre? 
R: La madre quiere saber si el 
nino se cepill6 los dientes. 

E: iQ\i€ quiere saber la madre? 
R: La madre quiere saber si la 

nina le puede ayudar a lavar 

los platos. 



Categorla iX-Frases de Mandato (Del Directo al Indirecto) 

EL ESTIMULO LA RESPUESTA ESPERADA DEL ESTUDIANTE 



Ejemplo: El maeatro le dice 

a la alumna: 'MDame 
el libro?*' 



Las Oracionea; 

26 « El maestro le dice a los 
alumnns: "iNo molesten a 
su vecino!" 



27. La maestra le dice a las 
ninas: *'|Leaa para mi!" 



(Examinador: El quiere que la 
alumna le di el libro« /;Qu^ 
quiere el maestro de la alumna?) 
(Respuesta esperada df,l estudiante: 
El quiere que la alurjna le d£ el 
libro*) 



E: iQu^ quiere el maestro de 
ellos? 

R: El maestro quiere que ellos 
no molesten a 3U vecino. 

E: IQui quiere la maestra de 

las nines? 
K: La maestra quiere que ellas 

lean para ella. 
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EL ESTIMULO 

28. La maestra le dice al 

nino: "tPonte el saco!" 



LA RESPUESTA ESPERADA DEL ESTUDIANTE 

E: £Qu£ quiere la maestra del 

nino? 

R: La maestra quiere que H se 
ponga el saco. 



Categorla X-Comparaci8p 

EL ESTIMULO 

Ejemplo: Esta nina estS 
cansada. 

Las Oraciones: 



LA RESPUESTA ESPERADA DEL ESTUDIAMTE 
Pero Esta nina esti (aun) mis cansada, 



29. Estas nines cantan bien Pero Esta nina canta (aun) nejor. 

30. Esta nina se siente mal. Pero ^.sta nina se siente (aun) peor. 

31. Esta nina corre r^pido. Pero Esta nina corre (aun) mSs rSpido. 

32. Esta nina tiene poco 

d:'nero. Pero Esta iiina tiene (aun) menos 

dinero. 
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APPENDIX C 

Percentage of Correct Responses on 
Vocabulary-by-Domaln Test 
(N-AO) 



Domain Item Spanish Engllah 



Home 1 97. 5X 100. OZ 

2 100.0 92.5 

3 95.0 92.5 

4 100.0 92.5 

5 95.0 100.0 

6 85.5 97.5 

7 97.5 100.0 

8 97.5 87.5 

Neighborhood 1 72.5 80.0 

2 97.5 100.0 

3 80.0 82.5 

4 90.0 80.0 

5 100.0 95.0 

6 87.5 100.0 

7 100.0 97.5 

8 95.0 80.0 

Church 1 65.0 70.0 

2 87.5 85.0 

3 52.5 20.0 

4 92.5 75.0 

5 77.5 57.5 

6 92.5 60.0 

7 87.5 75.0 

8 92.5 92.5 

School 1 97.5 97.5 

2 97.5 100.0 

3 80.0 80.0 

4 100.0 100.0 

5 67.5 75.0 

6 82.5 97.5 

7 45.0 82.5 

8 95.0 100.0 
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